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brief 


Duriag  the  avumoer  of  I961,  two  groups  of  students  at  the 
Fleet  Antl-Sulmrlne  Warfare  School,  San  Diego,  were  tested  on 
their  ability  to  make  target  axis  angle  estimates  from  sinnilated 
matericds  utilizing  the  angular  categories  in  the  EEL  claaalfi> 
cation  system.  One  group  received  a  30  minute  familiarization 
training  peiriod  while  the  other  was  simply  Introduced  to  the  task 
prior  to  testing.  It  is  concluded  that  neither  training  nor  the 
scope  quadrant  in  which  the  stimulus  appears  significantly  sdTfect 
accurausy  while  the  angular  category  does  (pp.  9  axid  U).  The 
dominant  error  tendency  is  toward  overestimation  of  an^pilstr  size, 
except  at  the  moat  acute  angular  categozy  (p.  lO).  Accttracy  of 
classification  within  the  Navy  Electronics  Laboratory,  San  Diego, 
system  ranges  from  50*2^  to  89.2^  depending  on  category,  with 
an  over-all  accuracy  of  68.0^  (p.  12).  The  majority  of  errors 
(92^)  are  of  only  one  categozy  in  extent  (p.l2). 
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JUDC2®HPS  OP  SBUJIATED  TARCET  AXIS  ANGLES  EC  MEANS  OF  A 
PEESCRIBED  CATEQOWC  SYSTEM 


A .  Lacksi-otuad 

The  general  question  of  the  ability  of  human  observers  to  esti¬ 
mate  angle  size  is  an  old  one.  A  wide  variety  of  techniques  have 
been  employed.  Some  researchers  have  req\iired  that  estimates  in 
degrees  he  made  { 1,  2,  il,  n) .  Others  have  required  that 

a  variable  be  set  equtkL  to  a  stand^d  or  have  utilized  both  esti¬ 
mation  and  adjustment  approaches  in  coabinaticm  (J,  $,  &,  lO) . 

The  majority  of  the  studies  requiring  numerical  estimatTon  have 
en^iloyed  visual  presentation,  although  at  least  one  writer  reports 
use  of  kinesthetic  input  for  the  estimate  (2).  Due  to  the  con¬ 
siderable  disparity  in  apparatus,  stimulus  properties,  response 
requirements,  etc.  in  the  literature,  it  is  not  possible  to  draw 
conclusions,  unambiguously,  concerning  either  the  susount  of  error 
in  degrees  to  be  anticipated  or  its  predominant  direction. 

Typically,  the  problem  of  target  classification  by  operators 
using  various  information  displays  requires  several  fairly  basic 
discriminations  or  Judgments.  One  of  these  is  an  operational 
requirement  for  the  estimation  of  angle  size  by  some  means  or 
another.  Reasonably  accurate  estimations  of  acute  angles  forms 
an  integral  part  of  the  Navy  Electronics  Laboratory  (MBL)  classifi¬ 
cation  system  (2.).  It  is  of  considerable  importance,  therefore, 
to  knew  something  about  the  limits  of  this  sort  of  Judgmental 
accuracy,  as  well  as  the  variables  which  may  influence  it.  In  a 
pilot  study  involving  four  subjects,  photos  from  both  real  and 
simulated  PPI  scopes  were  Judged  for  target  axis  angle,  and  median 
average  errors  of  13.9  and  2.98  degi^es  were  obtained,  respectively 
(U).  It  was  speculated  that  this  sort  of  skill  might  be  trainable. 
The  question  of  the  possible  effect  of  the  particular  scope  quad¬ 
rant  in  which  the  axis  angle  might  appear  was  not  investigated. 
Almost  no  data  exist  on  the  accxiracy  of  the  estimation  of  angle 
size  when  a  prescribed  category  system,  such  as  that  developed  at 
KEL,  has  been  imposed  on  the  subject  in  advance.  Also,  there  ie 
evidence  that  the  cursor-target  tjTpe  of  stimulus  presentation  poses 
a  very  different  problem  from  the  typical  procedure  of  other  in¬ 
vestigators  in  which  the  angle  is  Judged  relative  to  verbally  or 
visually  specified  coordinates  of  a  circle.  In  addition,  the  wide 
variations  in  category  size  in  the  NEL  system  pose  specific  ques¬ 
tions  that  are  difficult  to  answer  by  generalizing  from  the  existing 
evidence.  For  these  reasons  the  study  here  reported  was  condiSJted.^ 


^he  study  here  reported  is  part  of  a  series  of  investigations 
relating  to  the  ability  of  human  observers  to  accurately  assess 
certain  types  of  displayed  information.  The  plan  of  the  series 
aims  at  measuring  first  the  fundamental  psychophysical  functions 
involved,  with  close  control  over  atimulus  and  respoisse  features. 
This  stage  will  define  the  limits  of  the  ability  under  idealized 
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utilizing  simulated  target  axis  angles ,  the  investigation  was  de> 
sigzied  to  answer  the  following  questions  t 

1.  How  accurately  can  observers  be  expected  to  Judge  eu:is 
angles  utilizing  the  NBL  category  system? 

2.  What  is  the  relationship  between  accuracy  in  angular 
Judgment  and  the  angle  category  to  which  the  physical  stimulus 
belongs? 

3«  What  is  the  relationship  bettwen  accuracy  of  angular 
Judgment  aM  the  scope  quadrant  in  which  the  angle  is  displayed? 

4.  What  effect  does  tralnixig  in  axis  axigle  Judgment  have 
on  accuracy? 

T/hat  is  the  relationship  bet^reen  the  constant  errors 
in  axis  angle  Judgment,  if  any,  and  the  angle  category,  scope 
quadrant,  and  training  variables? 


B.  Procedures 


1.  Subjects 

The  sasple  consisted  of  60  students  in  the  Basic  Surface 
Sonarman  Course  C-^60G  at  the  Fleet  Anti-Submarine  Warfare  School, 
San  Diego.  The  subjects  were  randomly  assigned  to  two  experl- 
nentsd  conditions. 

2.  Apparatus  and  Test  MaterieJ-S 

To  provide  maximum  control  of  the  e:cperlmentel  variables  and 
to  approach  the  limit  of  subject  capacity  at  the  task,  the  test 
stimuli  were  simulated  by  zoaking  them  up  in  line  drawing  form, 
photographing  them  on  3^  nm  film,  and  then  projecting  them  at  the 
time  of  the  test.  By  this  meeuis,  the  8u:ls  angle  of  each  stimulus 
could  be  specified  precisely;  something  quite  difficult  to  do  with 
real  PPI  photos.  The  test  materials  constituted  an  uncluttered, 
"noise-free"  simulation  of  the  operational  task  of  discerning 
cursor-target  angle.  Real  PPI  displays  contain  the  additional 
problem  of  decidizig  on  the  major  eucis  of  the  target  pip,  which  is 
often  quite  ambiguous.  It  can  reasonably  be  assumed,  therefore, 
that  performance  will  be  degraded  in  the  operational  setting  from 
what  is  here  reported.  Figure  1  presents  a  typical  test  item. 


circumstances.  This  will  be  followed  by  investigations  in  which 
the  operationad  sitviation  is  more  and  more  closely  approximated. 
The  study  here  reported  is  em  intermediate  one,  involving  both 
controlled  simulation  and  operational  features. 
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Major  Axis  of 
Target  Pip 

Axis  Angle 
Bearing  Cursor 


Fig.  1*  Bepresentatlve  test  item 
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Axis  angle  Is  defined  as  the  extent  of  the  acute  angle  formed  hy 
the  hearing  cursor  and  the  major  axis  of  the  target  pip.  It 
follows  that  it  can  vaTy  from  0-90  degrees . 

In  order  to  determine  whether  the  particular  location  on  the 
scope  t&ce  of  the  target-cursor  Intersection  might  hear  critically 
on  Judgmental  acciiracy,  each  test  Item  was  constructed  so  as  to 
appear  In  each  of  the  four  scope  quadrants.  Qiiadrants  were  de¬ 
signated  as  shovm  in  Figure  2. 

Since  a  principal  goal  of  the  study  was  to  evaluate  angular 
Judgments  within  the  framework  of  the  lEL  category  system,  axis 
angles  were  selected  to  test  the  various  aspects  of  this  system. 
Table  1  pTOsents  the  upper  and  lovrer  limits  of  the  lOSL  categories 
and  the  test  stimuli  used  for  Judgment  within  each. 


TABIE  1 

NEL  Axis  Angle  Categories  euid  Test  Stimuli 
Within  Each  Category 


Category 

Test  Stimuli  in  1°  Steps 

1.  0°  -  19° 

9.5°  -  18.50 

2.  20°  -  59° 

20. 50  -  29.5°  &  49.50  -  58.50 

3.  60°  -  7^^° 

60.5°  -  73.5° 

4.  75°  -  84° 

75.5°  -  83.5° 

5.  850  -  90° 

85.5°  -  89.5° 

As  can  he  seen  from  this  table,  there  were  ^8  test  angles. 

E8w:h  was  presented  once  in  each  quadrant  so  tlmit  thez«  was  a 
total  of  232  test  items.  Within  the  constraint  that  all  stimuli 
appear  in  all  quadremts  once,  the  items  trere  randomly  ordered  for 
test  presentation. 

Presentation  of  test  items  was  hy  means  of  a  Revere  3^  mm, 
self -advancing,  timed  projector.  Each  item  appeared  for  12 
seconds,  which  pre-testing  indication  was  adequate  for  such 
Judgments.  Slides  were  numbered  to  assure  that  subjects  would 
enter  their  responses  on  the  answer  sheets  appropriately.  The 
answer  sheets  consisted  of  five  columns  each  lahled  with  the  vipsar 
and  lower  limits  of  one  of  the  EEL  categories  and  axiother  column 
designating  item  number. 
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Fig.  2.  Scope- quadrant;  designations. 
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3*  Training  and  Testing  Procedure 


The  experiioental  groups  were  distinguished  on  the  hasls  of 
whether  or  not  they  received  a  30  minute  training  period  designed 
to  fcunilieurlze  them  with  anguleur  Judgments.  Training  consisted 
of  exposing  test  stimuli  in  5  degree  intervals  from  0  to  90  degrees 
and  from  90  to  0  degrees,  and  following  response,  providing  im¬ 
mediate  linowledge  of  results. 

Before  testing  hoth  groups  received  the  following  instructions 
on  the  task: 

"Please  turn  to  the  front  of  your  answer  hooldet  and  write 
your  name.,  last  name  first,  your  rate,  your  class  number  and  the 
date. 

"You  are  about  to  see  some  slides  that  look  lilM  this. 
(Project  first  sample  slide  on  the  screen). 

"Now  look  at  your  answer  sheet.  You  will  notice  that  it 
has  five  col\imns  with  headings  of  0  to  19  degrees;  20  to  59  degrees; 
60  "^o  7^  degrees;  75  bo  84  degrees;  or  o5  to  90  degrees.  You  are 
to  determine  whether  the  acute  angle  foiTed  by  the  intersection 
of  the  two  straight  lines,  here  (point  to  acute  euagle  oa  screen) 
falls  within  the  range  of  0  to  19;  20  to  59;  60  to  74;  75  to  84; 
or  85  to  90  degrees.  You  will  recall  that  an  acixte  angle  is  less 
theui  90  degrees— or  less  thtin  a  right  angle. 

"The  angle  you  are  looking  at  on  the  screen  now  is  a  60° 
angle,  therefore,  it  is  in  the  6o  to  74  degree  range.  The  next 
slide  (show  next  sample  slide)  has  a  30^  angle,  kliich  column 
should  be  checked  for  itt  (Be  sine  that  everyone  understands  how 
to  mark  answers.) 

"The  next  slide  you  see,  and  those  that  follow  it,  will 
have  a  number  in  the  upper  left,  here.  (Point  to  upper  left  of 
slide  on  the  screen. )  Commencing  with  the  neid;  slide  which  is 
number  one,  please  mark  your  answer  on  the  answer  sheet.  The 
number  of  the  line  you  check  on  the  answer  sheet  must  correspond 
with  the  number  appearing  on  the  screen, 

"Hew  look  at  the  column  headings  again.  They  are  0  to  19; 
20  to  59;  60  to  74;  75  to  84;  and  85  to  90  degrees.  You  may  look 
at  them  as  often  as  you  need. 

"Are  there  any  questions?"  (Commence  showing  slides.) 

The  testing  of  each  group  was  carried  out  separately,  and 
the  toted  teat  time  was  divided  into  two  equal  sessions  with  a 
"smoke  break"  between. 
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C.  Remits 


Tbe  data  were  initially  reduced  to  three  msaaures:  (l)  Aver¬ 
age  error  of  each  aubject  in  categorizing  stimuli  near  the  bound¬ 
aries  sepeucatlng  tbe  categories^  (2)  Constant  error  in  categorizing 
tbe  same  boundary  stimuli,  and  (3)  Percentage  of  Judgments  placing 
each  stimulus  in  each  category.  Only  stimll  near  the  boundaries 
of  tbe  system  were  used  for  measiures  (l)  and  (2)  because  the  nuniber 
of  correct  Judgments  at  distances  greater  than  5°  from  tbe  boundary 
were  quite  high  and  would,  therefore,  have  added  little  to  the 
analyses  of  the  main  effects. 

Tbe  procedure  for  determining  avereige  error  involved  averaging 
responses  to  stimuli  1,  Sj  and  3  degrees  from  each  side  of  each 
boundary  for  each  category  by  means  of  a  weighting  which  led  to 
scores  in  arbitrary  \niits.  (See  Append!::  A  for  a  description  of 
the  means  for  arriving  at  these  units . )  Scores  ranged  from  a  per¬ 
fect  score  of  zero,  when  an  stimuli  were  correctly  Judged  to  30^ 
when  all  were  incorrectly  categorized.  The  number  of  category 
stei>s  ty  which  the  Judgments  were  in  error  was  disregarded. 

The  procedure  for  determining  constant  error  employed  the  sane 
stimuli,  but  regrouped  so  as  to  have  principal  reference  to  the 
category  boundaries,  rather  than  the  categories  themselves.  The 
purpose  of  this  scoring  was  to  obtain  a  measure  of  axiy  predcxBinant 
direction  of  mis  Judgment  as  a  function  of  the  principal  experimental 
variables.  The  scoritg  procedure  resxilted  in  scores  in  arbitrary 
units  ranging  from  9  ^or  crossing  a  boundary  consistently  in  the 
direction  of  underestimation  to  13  for  boundary  crossing  con¬ 
sistently  in  the  direction  of  overestimation.  A  score  of  12 
represented  unbiased  Judgments  on  tbe  average.  (See  Appendix  B 
for  a  description  of  the  means  for  eurrlviiig  at  these  units.)  The 
number  of  category  steps  by  which  the  Judgments  were  in  error  was 
disregarded. 

In  analyzing  the  percentage  of  subjects  placizg  each  stimulus 
in  each  category,  all  stimuli  were  enployed  with  the  exception  of 
the  0136  at  17.3  degrees  for  which  there  was  evidence  of  inaccuracy 
in  the  stimulus  drawing. 

Table  2  presents  the  mean  average  error  for  each  of  the  eicperi- 
mental  variables,  and  Table  3  presents  an  analysis  of  variance  of 
the  average  error  data. 

From  the  standpoint  of  the  aicis  angle  classification  problem, 
the  potentially  inporteuxt  results  of  this  analysis  are  the  slg- 
Dlflcemt  F  values  for  the  category,  wd  quadrant  x  category  ixxter- 
actlon  and  the  failure  of  significance  of  tbe  group  and  quadrant 
variables . 
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An  examination  of  the  mean  average  error  scores  Involved  in 
the  category  factor  (Table  2)  indicates  that  the  effect  arises 
from  the  considerably  greater  accuracy  with  which  the  first  and 
fifth  categories  are  esqployed. 


TABLE  2 

Mean  Average  Error  in  Categorizing  Stimuli 
(Units  Arbitrary,  Showing  Relative  Position  Only-See  Appendix  A) 


Variable  liean  Average  Error 


Category 

o 

1 

o 

o 

6.5^ 

o 

1 

o 

l3.i:-6 

3.  6o°  - 

ihM 

O 

1 

o 

• 

13.65 

5.  85°  -  90° 

3.67 

Qviadrant 

1.  Upper  Right 

10.25 

2.  Lower  Right 

10.45 

3.  Lcwer  Left 

10.03 

4 .  Upper  Left 

10.70 

Group 

1.  Trained 

9.83 

2.  Untrained 

10.85 

An  examination  of  the  category  means  by  quadrant  revealed  em 
unsystematic  variation,  but  suggested  no  reeuly  interpretation. 

The  failure  of  the  training  and  quadrant  variables  to  reach  sig¬ 
nificance  has  several  Inqpllcatlons  which  will  be  considered  later. 
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Analysis  of  Variance  of  the  Average  Error  Scores 


Source  of  Variance 

Error 

Term 

d.f. 

Mean  Scuare 

P 

a. 

Mean 

1 

b. 

Group  -  Trained  vs. 
Untrained 

c 

1 

314.31 

3.196 

Ce 

Sxibjects 

1 

58 

■  98.34 

3.282* 

d. 

Quadrant 

f 

3 

24.53 

a  • 

Quadrant  x  Group 

f 

3 

15.01 

— 

f. 

Quadrant  x  Subjects 

1 

174 

24.57 

— 

g« 

Category 

i 

k 

5,793.58 

4.507* 

h. 

Category  x  Group 

i 

k 

262.04 

2.036 

i. 

Category  X  Subjects 

1 

232 

128.56 

4.292* 

J* 

Quadrant  x  Category 

1 

12 

140.01 

4.675* 

k. 

Quadrant  x  Category  x 
Group 

1 

12 

38.07 

1.271 

1. 

Quadrant  x  Category  x 
Subjects 

696 

29.95 

Total 

1200 

*Signlf leant  beyond  the  level. 


Table  k  piresents  the  mean  constant  error  for  each  of  the  experl - 
mental  variables ^  and  Table  $  presents  the  results  of  an  analysis 
of  variance  of  the  constcuit  error  data. 
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TABLE  U 


Mean  Constant  Error  in  Categorizing  Stimuli 
(Units  Arbitrary-Showing  Relative  Position  On}.y-See  Appendix  B) 


Variable 

Mean 

Constant  Error 

Boundary 

1.  19.5 

-.08 

2.  59.5 

1.39 

3.  74.5 

1.30 

4.  84.5 

l.o8 

Quadrant 

1.  Upper  Right 

.94 

2.  Lower  Right 

.80 

3.  Lower  Left 

1.02 

4.  Upper  Left 

.95 

Group 

1.  Trained 

.76 

2.  Untrained 

1.08 

It  is  apparent  that  much  tl»  same  set  of  relationships  emerge 
fjrom  the  constant  error  as  from  the  average  error  analysis;  i.e., 
training  and.  quadreuit  fail  of  significance,  vhile  boundeofy  and 
its  interaction  with  quadrant  are  significsuit.  From  Table  4,  the 
significant  boundary  effect  can  be  seen  to  arise  from  the  tendency 
to  overestimate  stimuli  at  boundaries  2,  and  U. 

An  examination  of  the  boundary  means  qviadrant  revealed  an 
xusystematlc  variation  which  suggested  no  ready  interpretation. 

The  failure  of  significance  of  the  training  and  quadrant  variables 
will  be  deedt  with  in  the  next  section. 
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AiBlysis  of  Variance  of  the  Constcmt  Error  Scores 


Source  of  Variance 

Error 

Term 

d.f. 

Mean  Sduare 

F 

a.  Mean 

1 

b.  Group-Trained  vs 
Untrained 

e 

1 

24.22 

2.925 

c •  Subjects 

1 

58 

8.28 

15.623* 

d.  Quadrant 

f 

3 

2.12 

2.019 

e.  Quadrant  x  Group 

f 

3 

1.76 

1.676 

f.  Quadrant  x  Subjects 

1 

174 

1.05 

1.981* 

g.  Boundary 

1 

3 

110.62 

23.046* 

h.  Boundary  x  Group 

1 

3 

2.32 

1.  Boundary  x  Subjects 

1 

174 

4.80 

9.057* 

J.  Quadrant  x  Boundary 

1 

9 

3.57 

6.736 

k.  Quadrant  x  Boundary  x 
Group 

1 

9 

.41 

— 

1.  Quadrant  x  Boundary  x 
Subjects 

522 

.53 

— 

Total 

960 

*Slgnif leant  teyond.  the  level. 


Table  6  presents  the  mean  percental  of  the  stimuli  correctly 
Judged  over-all,  and  by  category,  for  all  of  the  test  stImMll 
cooiblned  and  for  the  boundary  stimuli  enployed  In  the  error  analyses. 
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TABLE  6 


Mean  Percentage  Correct  Judgments 
By  Category  and  Over-all 


1 

2 

Category 

3  4 

5 

Over-all 

All  Stimuli 

86.3 

61. U 

50.2  53.1 

89.2 

68.0 

Boundary 

Stimuli 

72.5 

49.0 

49.0  51.7 

86.0 

61.6 

It  is  cleeu:  that  by  both  indices  the  percentage  data  are  con¬ 
sistent  with  the  average  error  analysis  in  indicating  the  greater 
accxiracy  of  category  1  and'  5  stimulus  Judgments  over  those  for 
the  three  central  categories. 

Figure  3  presents  the  percentage  of  correct  Judgments  for  all 
axis  angles  tested  (excluding  17 degrees  which  was  Improperly 
drawn) .  The  overes'tlmation  tendency  is  clear  in  the  decreasing 
nunlber  of  correct  Judgments  as  the  upper  boundaries  of  categories 
2,  3 1  and  4  are  approached,  as  coo^ared  with  the  accuracy  of  the 
JudgEoents  at  the  lower  boundaries  of  the  same  categories.  This 
characteristic  is  not  found  at  the  lower  boundary  of  category  2, 
which  is  consistent  with  the  near  zero  constant  error  at  this 
particular  point. 

Neither  the  average  nor  constant  error  analyses  considered 
the  extent  of  mis categorization  error.  To  get  at  this,  the  per¬ 
centage  data  were  tab\ilated  to  indicate  the  distribution  of  error 
frequencies  by  extent  of  the  error.  The  analysis  clearly  indi¬ 
cated  that  one  category  displacements  constituted  far  and  away 
the  dominant  source  of  all  errors --meilcing  up  92^  of  them,  while 
two  category  errors  were  found  in  only  7^  of  the  Judgments,  and 
Itfger  errors  made  up  less  than  l/lOOth  of  the  total. 


D.  Discussion 


The  failure  of  the  30  minute  familiarization  training  period 
to  produce  reliable  differences  in  the  accuracy  of  eucls  angle 
Judgments  Is  of  liqportance  in  any  system  such  as  NEL's  because. 

It  nay  either  mean  that  the  population  expected  to  make  these 
Judgments  cooes  to  the  problem  with  an  Informally  acquired  ability 
to  perform  without  formalized  Instruction,  or  that  the  very  brief 
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Percental  Correct  Judgments  \jy  Axis  Antpjs 


duration  and  nature  of  the  training  were  Inadequate.  Though  In 
both  the  average  and  constant  ^rror  analyses  the  training  factor 
was  insignificant,  the  direction  of  the  difference  was  in  the  ex¬ 
pected  direction.  It  is  quite  possible  that  a  more  extensive 
training  program,  aimed  at  curtailing  the  pattern  of  constant 
errors  found  in  these  data,  could  well  have  a  greater  infltience  j 
particularly  when  the  added  load  of  determining  the  target's  major 
axis  from  the  more  ambiguous  stimuli  of  a  real  PPI  scope  is  in¬ 
volved. 

The  failure  of  the  scope  qiiadrant  variable  even  to  approach 
significance  is  certainly  a  welcome  result  from  the  operational 
steuadpoint,  since  it  means  that  neither  over-all  accuracy  nor 
predominant  error  direction  should  be  expected  to  be  influenced 
by  the  particular  scope  location  in  which  a  target  may  appear. 

There  is  no  reason  to  expect  this  result  not  to  be  applicable  to 
real  FFI  scope  material. 

The  constant  error  analysis  is  more  nearly  in  accord  with  those 
investigators  who  report  a  predominant  tendency  twoard  angular 
overestimation  than  those  reporting  the  reverse;  the  exception 
being  near  the  most  acute  angular  category  where  there  is  virtually 
no  constant  error.  As  suggested  above,  this  result  provides  di¬ 
rection  in  preparing  training  materials  pertaining  to  this  type 
of  judgment.  As  with  quadrant  effects,  there  is  no  reason  to 
suppose  that  these  constant  error  relationships  are  not  applic¬ 
able  to  the  operational  stimulus  situation. 

The  significant  boundary  emd  category  effects  are  difficult 
to  interpret  because  of  a  couple  of  artifacts  inherent  in  the 
category  system  used.  First  there  is  the  range  constraining 
effect  of  restricting  judgments  to  4  of  a  complete  circle  of 
angles.  As  a  result,  is  was  not  possible  either  to  obtain  a  neg¬ 
ative  error  on  category  1  stimuli  or  a  positive  error  on  cate¬ 
gory  5  stimuli.  To  some  extent,  this  accounts  for  the  lower  error 
rates  within  those  categories,  as  well  as  the  pattern  of  coz}Stant 
error  scores  at  their  boundaries.  A  second  artifact  is  the  vari¬ 
able  size  of  the  categories,  which  lilcely  produced  some  undeter¬ 
mined  distortion  on  all  meastires.  This  is  not  to  imply  that  the 
operational  usefulness  of  the  conclusions  regarding  category 
differences  is  thereby  reduced.  On  the  contrary  these  data  re¬ 
flect  the  effects  to  be  expected  within  the  proposed  axis  euigle 
category  system,  and  are  directly  applicable  to  any  developments 
or  modifications  in  the  system  which  might  be  contemplated  as  a 
result. 

Without  an  extensive  study  of  the  influence  of  verious  levels 
of  average  and  constant  errors  at  various  dividing  points  in  the 
NBL  categories,  it  is  difficult  to  assess  the  significance  of  the 
percentage  correct  judgment  data  on  final  tcurget  classification. 
Whether  a  low  point  of  between  50^  and  60^9  correct  categorizing 
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in  the  cenfcral  categories  Is  too  great  for  the  system's  target 
classification  logic  to  tolerate  caxmot  at  this  time  he  stated*- 
peartlculeo'ly  since  the  extent  of  degradation  heyoaid  this  with 
PPI  scope  materials  is  still  unknown.  If  this  accuracy  is  in¬ 
adequate,  then  either  some  angle  estimation  assist  device  my 
have  to  be  developed,  or  a  more  extensive  training  program,  aimed 
at  the  sorts  of  errors  revealed  in  this  research,  will  be  needed. 


E.  Sugtiiar/  end  Conclusions 


In  order  to  assess  the  accuracy  with  which  observers  can  be 
expected  to  mali»  certain  angular  Judgmejits  of  lng>orteuice  in  target 
classification  by  scanning  sonar,  a  study  was  csonrled  out  utiliz¬ 
ing  line-drawing,  idealized  simulations  of  PPI  scope  presentations 
of  target  axis  angles.  The  subjects  were  required  to  estimate  the 
angles  by  means  of  the  EEL  category  system.  One  group  of  subjects 
was  given  30  minutes  of  familiarization  training,  while  the  other 
group  was  simply  introduced  to  the  task. 

The  following  conclusions  can  be  drawn: 

1.  Both  in  terms  of  average  and  constant  error,  neither 
the  training  received  nor  the  quadrant  of  the  scope  in  which  the 
test  angles  appeared  had  a  significant  Influence  on  accuracy. 

2.  Both  in  terms  of  average  and  constant  error,  accviracy 
was  Influenced  significantly  by  the  angular  category  of  the  test 
stimuli;  being  higher  at  the  extreme  upper  and  lower  categories. 

Two  artifacts  in  the  category  system  which  may  well  have  Influenced 
this  result  were  pointed  out. 

3.  The  dominant  tendency  was  for  axis  angles  to  be  over¬ 
estimated,  except  at  the  most  acute  angular  category,  where  little 
constant  error  was  found. 

4.  The  percentage  of  correct  judgments  ranged  from  50.2Va 
to  09. 2^9,  depending  upon  category.  The  over-adl  accuracy  was 
68.0^.  The  great  majority  of  misclassifications  (92.0^)  were  of 
only  one  category  displacement  in  extent. 

5.  The  failure  of  the  training  here  used  to  produce  sig- 
nificeurt  effects  indicates  an  approach  to  training  in  terms  of 
dominant  constant  error  tendencies. 
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APIENDIX  k 


PROCEDURES  FOR  CCMVriNG  MEAN  AVERAGE  ERROR 


Mean  average  error  per  categorj'^  was  olstained  by  utilizing 
stimuli  1,  and  5  degrees  from  the  upper  and  lower  category 
boundaries.  Since  category  1  has  only  an  upper  boundary  within 
the  SO  degree  arc,  and  category  5  only  a  lower  boundary^  the  re¬ 
sults  from  only  3  stimuli  each  were  eraployed  in  their  averages. 

On  the  other  hand,  categories  2  and  3  both  have  two  boundaries  * 
i.e.,  upper  and  lower,  so  that  judgments  of  6  stimuli  each  were 
employed  in  their  averages.  Although  category  4  has  both  an  upper 
and  a  lower  boiaidary,  the  small  size  of  the  category  restricted 
the  number  of  stimuli  to  be  averaged  to  Because  of  the  differ¬ 
ing  number  of  stimulus  judgments  entering  into  the  mean  average 
error;  i.e.,  3  for  categories  1  and  5;  6  for  categories  2  and  3; 
and  5  for  category  4,  the  common  denominator  of  3,  5>  and  6r  i.e., 
30  was  employed  to  get  a  coopeurable  value. 

Specifically,  if  an  observer  got  all  test  stimuli  correct  in 
any  category  he  received  a  score  of  30.  If  he  miscategorized  all 
stimuli,  he  scored  zero.  Each  error  in  categories  1  and  5  sub¬ 
tracted  10  points  from  the  total  possible  of  30.  Each  error  in 
categories  2  and  3  subtracted  5  points,  and  each  error  in  category 
4  subtracted  6  points. 


APiEiron  B 


PROCEDURES  POR  COMPUTING  MSAK  CONSTAKT  ERROR 


Direction  of  error  tendency  was  of  principal  interest  in  this 
analysis  so  that  the  arbitrary  unit  scoring  system  en5>hasized 
this  aspect.  Stimuli  1,  3^  5  degrees  above  and  below  each  of 

the  boundaries;  i.e.,  19*5^  58* 5^  7^-5  and  Sk.^  degrees,  were 
utilized.  This  resulted  in  6  stimuli  being  employed  in  the  total 
score  at  each  boundary.  A  score  of  2  ^ras  assigned  all  judgments 
showing  no  constant  error,  a  score  of  1  to  those  showing  under- 
classification,  and  a  score  of  3  to  those  showing  overclassifica¬ 
tion.  Thus,  if  a  stimulus  near  the  upper  boundary  of  a  category 
was  judged  as  falling  in  that  category  or  lower,  a  score  of  2 
was  recorded.  Likewise,  if  a  stimulus  near-  the  iCT/er  bo\mdary  of 
a  category  was  judged  as  falling  in  that  category  or  higher,  a 
score  of  2  was  recorded.  However,  aro'  stimulus  near  an  upper 
boundarj--  which  was  judged  as  falling  in  a  higher  category  was 
scored  3>  while  any  stimulus  near  a  lower  boundary  which  was  judged 
as  falling  in  a  lower  category  was  scored  1. 

Since  there  are  only  5  stimuli  available  in  category  4  in  2 
degree  steps,  the  stimulus  in  the  middle  of  this  category;  i.e., 
79*5  degrees,  was  scored  twice  for  each  subject;  once  as  a  lower 
and  once  as  an  upper  boundary  stimulus. 
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